To appear in Probability Theory and Related Fields 



Central limit theorem for triangular arrays of 
Non- Homogeneous Markov chains 

Magda PeligracQ 



Department of Mathematical Sciences, University of Cincinnati, PO Box 
210025, Cincinnati, Oh 45221-0025, USA. Email: peligrm@ucmail.uc.edu 



Abbreviated Title: CLT for non-homogeneous Markov chains 

Key words: central limit theorem, triangular arrays, non-homogeneous Markov 
chains, maximal coefficient of correlation. 

AMS 2000 Subject Classification: Primary 60F05, 60J10, 60G48. 

Abstract 

In this paper we obtain the central limit theorem for triangular arrays of 
non-homogeneous Markov chains under a condition imposed to the maximal 
coefficient of correlation. The proofs are based on martingale techniques and 
a sharp lower bound estimate for the variance of partial sums. The results 
complement an important central limit theorem of Dobrushin based on the 
contraction coefficient. 



1 Introduction and notations 

More than fifty years ago Dobrushin [3] proved a definitive central limit the- 
orem for non-homogeneous Markov chains. His work is based on the coefficient 
of ergodicity which is defined by using the contraction coefficient, specifically for 
uniformly bounded functions. In a recent paper, Sethuraman and Varadhan [16) 
give a new and elegant proof of Dobrushin's result and provide a survey of the 
literature that was generated by it. In this paper we address a similar problem 
for Markov chains by using the maximal coefficient of correlation, instead of the 
contraction coefficient. This coefficient is more general and the results are ap- 
plicable to a larger class of Markov processes. The problem is challenging, since 
the maximal coefficient of correlation is defined for functions that are square 
integrable only and many new tools have to be developed. 
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and NSA grants H98230-09-1-0005 and H98230-11- 1-0135. 



1 



Let (fi,/C, P) be a probability space and let A, B be two sub cr-algebras of 
/C. Define the maximal coefficient of correlation 



p(A,B) = sup \corr(f,g)\ , 

/GL 2 (^) :5 GL 2 (B) 

where L2 (-4) is the space of random variables that are A measurable and square 
integrable. For a vector of random variables, (Yfc)i<fc<« we define 

p k = max p(a(Yi,i < s),a(Yj,j > s + k)) . (1) 

l<s,s+fc<n 

For a nonhomogeneous Markov chain of length n, (£j)i<j< n , it turns out that 
the computation of pk simplifies (see for instance Theorem 7.2 (c) in [1 ). For 
this case, 

p k = max p(cr(£ s ),cr(£ s+k )) . 

l<s,s+/c<n 

Moreover (see Theorem 7.4 (a) in [1]), for all 1 < k < n — 1, 

Pk < Pi ■ 

In terms of the conditional expectation (see chapter 7 in [14] or Theorem 4.4 
(b3) in [I]) an alternative definition of pi is 

pi = max sup{ l|E( f ( ^'- l)l12 ; ||<K&)|| 2 < 00 and E fl &) = 0} , (2) 

2<i<n g \\9{&)\\2 

where we used the notation = (E\X\p)^p, for p > 1. 

For a stationary Markov chain defined on (Q, JC, P) with values in (X, B(X)) 
with invariant measure 7r and transition probability A) — P(£i € 4|Co — 
x), define the operator Q acting on Ii2(X,B(X),tt) via 

(Qu)(x) = I u(y)Q(x,dy) . (3) 
J x 

Denote L^tt) = {g 6 L 2 (X,B(X),n) with J grf7r = 0}. With these notations, 
the coefficient pi is simply the norm operator of Q : L^ 71 ") "~ ► ^C 71 "); 

linn MQCgOjlg /.x 

Pl = l|Q||L°(7r) = SUp — 1 — n . (4) 

gem*) \\9\\2 

Conditions imposed to the maximal coefficient of correlation make possi- 
ble to study the asymptotic behavior of many dependent structures including 
classes of Markov chains and Gaussian sequences. This coefficient was used by 
Kolmogorov and Rozanov [5] and further studied by Rosenblatt [TJ] , Ibragimov 
[B], Shao [15] among many others. An introduction to this topic, mostly in the 
stationary setting, can be found in the Chapters 7, 9 and 11 in Bradley pQ. 
Application to the central limit theorem (CLT) for various stationary Markov 
chains with pi < 1 are surveyed in Jones (HJ. In the nonstationary setting and 



2 



general triangular arrays a central limit theorem was obtained by Utev [T7] , as- 
suming a lower bound on the variance of partial sums and p— mixing coefficients 
converging to uniformly at a logarithmic rate. 

In this paper we are concerned with the central limit theorem for a triangular 
array of Markov chains. Let (£ n ,i)i<i<n be an array of non-homogeneous Markov 
chains defined on a probability space (il,IC,P) with values in (X,B(X)). In 
addition, let (f n ,i)i<i<n be real valued functions on X. Define, 

n 

X n ,i — fn,i(£,n,i) and S n — ^ X n ^ ■ (5) 

i=l 

Everywhere in the paper we shall assume 

EI„, = 0, EX 2 ; < oo 



and denote by 



ofj = var S n and b n = var X n ^ , (6) 



where var X — E(X — EX) 2 . In this context, the mixing coefficients need an 
additional index to indicate the row. We shall write now p n ,i instead of p\ to 
specify that this coefficient is computed for (£ n ,i)i<i<n- 

We shall establish in Proposition[T2]that for all n > I, the quantities a n and 
b n are related by the following inequality 



1 + Pn,l 1 - pn,l 
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provided p n .\ < 1- 

We shall further discuss the rate at which the maximal coefficients of cor- 
relation, p n ,i, are allowed to converge to 1, for the validity of the central limit 
theorem for S n /a n . 

The results are formulated both in terms of bounded random variables and 
also in an integral form similar to the Lindeberg condition. When applied to a 
triangular array of uniformly bounded random variables, with the variance of 
individual summands uniformly bounded below, our sufficient condition for the 
central limit theorem is implied, for instance, by 

(1 — Pn,i) nQim) — > oo as n — > oo . (7) 

We can see from this result that we obtain the central limit theorem not only 
for the situation when p Ut \ < r < 1. We can let p n> i approaches I, but not too 
fast, at a rate that will be specified. 

The proof of this result and the other results of this type are based on the 
following tools we develop in this paper that have interest in themselves: 

(1) General sufficient conditions for the CLT for triangular arrays, based on 
a familiar projective martingale representation. 
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(2) Sharp lower and upper bounds for the variance of sums of variables 
connected in a Markov chain. 

(3) Moment and exponential inequalities for certain partial sums. 

Our theorems are related to Dobrushin's result which uses as a measure of 
dependence the contraction coefficient 

5(Q) = sup sup \(Qu)(xi) - (Qu)(x 2 )\ , 

where U = {u, sup a . i — u{x2)\ < 1} and the operator Q is defined by 

([3]), on the space of bounded measurable functions. For a triangular array of 
Markov chains {$, n ,i)i<i<n with transition probabilities Q n ^{x, A) — P(£ n ^±i £ 

A\£,n,i = X), 

S n .i = sup S(Qn ti ) and S n . k < 8* L . (8) 

l<i<n-l 

By Lemma 4.1 in Sethuraman and Varadhan |16) we have 

Pn,i < <V,l . 

Dobrushin [3] showed that for a triangular array of uniformly bounded random 
variables, with the variance of individual summands uniformly bounded below, 
a sufficient condition for the CLT is 

(1 — S„ : i) 3 n — > oo as n — > oo . (9) 

Moreover, he analyzed an example attributed to Bernstein, of family of Markov 
chains satisfying 1 — <5„ i = n 1 / 3 and such that the CLT fails. The initial proof 
of this result is very long. A simplified proof of a further reaching result can 
be found in Sethuraman and Varadhan [TB] (see also Theorem [5}. For the 
properties of this contraction coefficient we refer to Iosifescu and Theodorescu 
[7], sections 1.1. and 1.2. 

There are plenty of examples for which 8 n> \ — 1, but p n< i < 1, so our results 
have a larger sphere of applicability than the results based on <5 n ,i. 

For instance, for a row-wise stationary array of Markov chains with joint 
distribution of (£ n ,i, £71,2) bivariate normal, the maximal coefficient of correlation 
is very simple, namely p n ^\ — \corr{^ n> x, £n,2)|> while (if i.i.d. rows are excluded) 
§n,i = 1 for all n (for a convenient reference to this fact see pQ, Theorems 9.1 
and 9.7). For functions of variables in this array our theorems are applicable, 
and the conditions are very easy to verify. 

Moreover, even for the situation when 8 n> i < 1, it is possible that p n> i — > 1 
and S n ,i — > 1 at different rates, such that, for instance, ([7]) holds but ([9]) does 
not. Such an example can be easily constructed by using a recent result by 
Bradley [2], who showed that for any < a < b < 1 there is a stationary 
Markov chain for which p\ — a and 8% = b. 

Our results will be useful for treating families of various Markov processes 
that are considered in applications. For example, Liu et all |10) have shown that 
if the operator induced by a Gibbs sampler satisfies a Hilbert-Schmidt condition 
then pi < 1. 
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Another class of examples is provided by an array of stationary reversible 
Markov chains that are geometrically ergodic. A stationary Markov chain is 
called geometrically ergodic if there is < t < 1 and a nonnegative function 
M(x) such that ||Q n (:c, •) - 7r(-)|| < M{x)t n . A stationary Markov chain that is 
geometrically ergodic and reversible satisfies pi < 1. (Roberts and Rosenthal, 
[T^]V A particular example of this kind is the popular Random Walk MHG 
Algorithms which are reversible by construction. In Mengersen and Tweedie 
[11] it was shown that the random walk samplers cannot be uniformly ergodic 
(so Si — 1) but they do establish that a random walk MHG algorithm can be 
geometrically ergodic in some situations, therefore they have p\ < 1. This work 
was extended in Roberts and Tweedie [IB] , 

Our paper is organized as follows: In Section 2 we state the main results. In 
order to prove them, in Section 3 we develop sufficient conditions for the CLT 
for triangular arrays of random variables based on martingale representations. 
Section 4 is concerned with bounds for the variance of partial sums of a Markov 
chain as a function of the p\ coefficient. The proofs of the main results are the 
subject of Section 5. Some technical lemmas involving higher moments for sums 
and exponential bounds are postponed to the Appendix. 

The convergence in probability will be denoted — > p and — ?> D denotes con- 
vergence in distribution. 



2 Results 

Our first theorem applies to triangular arrays of functions of Markov chains 
consisting of bounded centered variables. To describe our results it is convenient 
to introduce the related coefficient 

A n = 1 - Pn.i = min [1 - p(cr(£„, s ), cr(£„, s+ i))] . (10) 

l<s<n— 1 

Clearly < A n < 1, and A„ is a coefficient of independence for (£ n ,i)i<i<n 
with n fixed. Notice that A„ = 1 if and only if the vector (A IV ;)i<;< n is 
independent. Everywhere in this section we shall consider the nondegenerate 
case i.e. X n b n > for all n > 1. By Proposition rj3] this condition is equivalent 
to A n cr„ > for all n > 1. 

Theorem 1 Suppose that (^ n ,i)i<i< n is defined by fSP and for some finite 
positive constants C' n we have 

max \X n ,i\ < C n a.s. (11) 

l<i<n 

C„(l + |ln(A„)|) 
— - 1 — - — — ^0 as n -> oo . (12) 

An<7n 

Then 

Xn - 1 4 N(0, 1) as n -> oo . (13) 
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We state a corollary which combines Theorem [T] with the bound of the vari- 
ance given in Proposition 1131 in Section 4. 

Corollary 2 Suppose that (X n ^)\<i<n is defined by filjjj). Assume that ill]) 
holds and 

C»(l + |ln(A»)|) 
A 3/2 /> 

Then the CLT {HP holds. 



as n — > oo . 



Next, we give a corollary that can be applied to an array of uniformly 
bounded random variables. 

Corollary 3 Suppose that (^n ) i)i<i<n is defined by |5p and assume that there 
are two positive constants C and c such that maxi<i<„ < C a.s. and also 

var X n ,i > c > for all n > 1 and 1 < i < n. Then CLT &13\) holds provided 

A 3 n(l + |ln(A n )|)- 2 ->oo. (14) 

Notice that © implies (fH)) . 

We shall also prove an integral form of Theorem [TJ 
Corollary 4 Suppose that {X n ,i)i<i<n is defined by and for every e > 
1 " 

- — j^EX^IilX^i] > eh{\ n )o- n ) asn^oo (15) 
A«cr„ , =1 

where h(X n ) = A„(l + | ln(A„)|)- 1 . Then the CLT (T^) holds. 

We now point out some immediate consequences of Corollary 01 

Remark 5 Let us notice that by using the bounds on the variance given in 
Provosition MSX condition U5\) is implied by 



1 n 

— J2 EX nJ(\ X ^\ >£h '( X M^° asn^^ (16) 

n b n i=1 



where h'(X n ) = A 3 „ /2 (l + | ln(A„)|) _1 . 

The next remark applies to triangular arrays of Markov chains with uni- 
formly bounded p n ,\ — mixing coefficients. 

Remark 6 Suppose that {X n ,i)i<i<n is defined by |5P and there is a positive 
number p such that sup Tl p„,i < p < 1. Then, the CLT H13\) holds provided that 
for every e > 



1 

-5>X r 2 M /(|X IM | >eb n )^0 



b 2 
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For arrays of Markov chains that are row-wise strictly stationary with the 
same invariant distribution, Corollary [4] (via Remark [5]) has a simple form. 
Examples of this type are arrays of Markov chains generated by parametric 
copulas. 

Remark 7 Suppose for each n, (£ n ,i)i<i<n * s a stationary Markov chain with 
the same invariant distribution ir and transition operator Q n . Let f G L^ 71 ") 
and define X„ t k — f{£ n ,k) a nd X n = 1 — ||Qn||i, (ir)- Then, the CLT [T3\) holds 
provided that for every e > 

/ ^ 2 ^ 7 ^^' > £ Vnh' (\ n ))dn -> as n -> oo . 

Finally, we mention the extension of Dobrushin's CLT obtained by Sethura- 
man and Varadhan [IB], by using the coefficient <5„,i: 

Theorem 8 Suppose that (-^ n ,i)i<i<n * s defined by (0) and relation ill]) holds. 
Denote a n = 1 — <5„.i- If 

C 2 

— r^r -> as n -> oo , (17) 
ct o 

then, the CLT 113\) holds. When |-X"n.,j| < C < oo a.s and var X n ^ > c > 0, /or 
all 1 < i < n and n > 1, then the CLT U3\) holds provided 

a^n — > oo as n oo . 

3 Central Limit Theorem for triangular arrays 

The following theorem is a variant of Theorem 3.2 in Hall and Heyde [5] (see 
also Ganssler and Hausler [4]). 

Theorem 9 Assume (fl n ,!)i<i<n is an array of square integrable martingale 
differences adapted to an array (J r n,i)l<i<n of nested sigma fields. Suppose 

E( max \D n j\) -> as n -> oo (18) 

1 <j<n 

and 

n 

TTien = 5Zi=i -^n,j converges in distribution to a standard normal variable. 
In this section we shall assume the following general setting: 

(CI) Assume (X nt j)i<j< n is an array of centered random variables that are 
square integrable and adapted to an array of sigma fields {F n ,j)i<j<n, with 
J^n.j C J- n .j+i for all 1 < j < n — 1. Extend the array with X n fi = and 
■7"n,o = { , ^} for all n. 

With this notation, as an immediate consequence of Theorem [9j we formu- 
late: 
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Corollary 10 Assume (CI) and let ES 1 ^ = 1. Define the projector operator 
P n>j Y = E(Y| F n ,j) - EfFl^-x) . 

Assume 

max |P nj -5„| -> p as n — > oo . (19) 

l<j<n ' 

and 

n 

^(P nj S„) 2 yiasn^oo. (20) 
i=i 

T/ien the CLT in US\) holds. 

Proof. Because we assume J-'nfi — { ,^}, we can express S n in terms of 
projections 

n n n 

S n = J]] X n< j — E(5„|J r „ J ) — E(S l n |J r nj -_i) = P nJ -5„ . (21) 

Notice that we have written SVi as a sum of martingale differences 

dn,j = E(S' n |J r n ,j) — ~Ej(S n \J- nj-i) = P n jS n = P n j(S n — Sj-i) (22) 

and we apply Theorem ®\ Since Y?j=i E(P nj -S„) 2 = ES* = 1, it follows that 
maxi<j<„ (PnjiS'nl is uniformly integrable in Li and then (|19[) implies (j 18[) . 

Analyzing the conditions of Corollary [TU] is leading us to the following useful 
theorem. For < j < n denote 

Anj — E(S' n — S n j\J- n ,j) , (23) 

where S n j = Y%=i X n,i 

Theorem 11 Assume (CI) and E5, 2 t = 1. Also assume that 

max j| + \A n A) — !- p as n — >• oo (24) 

l<j<n 

and 

n 

(Xn,j + 2X n,jA nj ) yiasii^oo. (25) 

j'=i 

Then S n converges in distribution to N(0,1). 

Proof. For simplicity we drop the index n in the notation, so Xj = X n j, 
Aj A n j^ dj — d n j. 

Condition (fT9|) follows from condition (l24l) since, by definitions (|22|) and 
(ESJ), 

\dj\ < \Xj\ + \AA + \Aj-!\ a.s. 



To verify condition (|2"U1) . for 1 < j < n let us compute 

df = {X j + A j -A j _ 1 f 

= (X 2 + 2XjAj) + A] - A)_ x + 2(A i _ 1 - X 3 - A s )A,-x 

whence, by definition (|22|) and the fact that Aq = A n — 0, we obtain 



3=1 3=1 3=1 

Now, by condition (|25p . the first term in the right hand side is converging in 
probability to 1. For the martingale transform Y^j—i djAj—% we use a truncation 
argument. Let e > and denote Aj — AjI(\Aj\ < e). For any a > 0, 



P(l£^'-il > «) < p ( 1 ma < ? I^-I > e) +P(lE^ A J-il > °) 

* — ' l<j<n * — ' 

i=i i=i 

n 

< P( max l^-l > e) +e 2 E(^d,) 2 /a 2 = P( max |^| > e) +e 2 / 

j=l 



a 2 . 



where on the last line we used the fact that E(Ej=i dj) 2 — 1. Then, we take into 
account that maxi<j< n \ Aj\ is negligible in probability by and we conclude 
the convergence to by letting n — > oo followed by e — > 0. It follows that 

n 

d 2 — > p 1 as n -» oo 

3=1 

and the CLT holds by Corollary [TOJ 

Theorem [Tl] has the following simple Corollary that will be used in our 
proofs: 

Proposition 12 Assume (CI) and the variables have finite moments of order 
4. Moreover assume the following conditions hold: 



1 - 

— 2J EI* tJ ^Oasfi^oo. (26) 

For every e > 



°* 3=1 



P( max > ea„) -> as n -> oo (27) 

l<j<n 

and 

1 " 

— wry](X^ + 2X ritj A n<j ) ->• as n ->• oo . (28) 

CT " 3=1 

TTien a~ S n converges in distribution to N(0, 1) . 
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Proof. Conditions ([2BJ and $27} easily imply ([M]). Then, condition 
implies (|25[) by taking into account that 



1 

— EQj^. + iur nj -A l j) = i 

" 3=1 





4 Bounds for the variance of partial sums of 
Markov chains 

In this section we establish sharp upper and lower bounds for the variance 
of partial sums of a Markov chain as a function of the maximal coefficient of 
correlation defined in . 

Proposition 13 Let (X%,X2, ...,X n ) be a vector of square integrable centered 
random variables that are functions of a Markov process {^i)i<i< n i-e. X^ = 
fk(£,k)- Denote by S n = J2i=i x i an & Fj = a (C^ * ^ j)- We set x — and 
Jo = {0,ft}. If pi < 1, then 

Proof. We prove first the lower bound. For this proof we recall the notation 
([6]) and (j23|) . which in this case is Aj — A n j — E(S n — Sj\£j). We start as before 
from the martingale decomposition 

n n 

S n = E (^n|^3) - E(5 n |^i-l) = ^ Pj($. ~ ^-l) ■ 
3 = 1 3=1 

By the orthogonality of the martingale differences 

71 

ol =^E[P i (5 n - S r i)f • (29) 

3 = 1 

Notice that by taking into account the Markov property and simple algebra 

E[P,(5„ - = E(Xj + A,) 2 + E(A,_i) 2 

-2E(X i +A J -)A j -i • 

By the definition of pi 

2|E(X / +A / )A i _ 1 | < 2pi||X j +^|| 2 ||A i _ 1 ||2 
^E^+^f+E^) 2 , 
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which combined with the previous identity gives 

E[P,-(5„ - S^)] 2 > (1 - p?)E(X, + A,) 2 . 
Therefore, by summing these inequalities we obtain 

n 

^>(l-p?)5>(X i + ^) 2 - (30) 

i=l 

On the other hand, by (j2T))) and the properties of conditional expectation 

n n 

i=l i=l 

By introducing this identity in relation (|30p and changing the variable of sum- 
mation we obtain 

«^>(i-p?)Ee^ + <^] . 

i=l 

Solving this inequality for cr 2 , gives 



-i> l —^i:^. (si) 

(If Pl = 0, then ElLi EA 2 =0.) 

Starting now from Xj = (X; + A;) — Aj, by the Cauchy-Schwarz inequality, 
we have 

EXf < E(X + A) 2 + EA 2 + 2||X + ^l|2||A|| 2 • 

We sum these inequalities, then we apply Holder inequality and finally use 
relations (|3T)]) and (|3"Tj) and some simple calculations to obtain 

n n 

bl <^E(X + A) 2 + E E ^+ 

i=l i=l 
1/2 

1+Pl 2 



2 ^E(x i + A) 2 E E ^ 



Therefore 



at > 



o=i 
1 -Pi 



1 I 71 

1 + Pi 

and the lower bound is established. 

We shall establish now the upper bound. By simple algebra, Cauchy-Schwarz 
and Holder inequalities, we have 



al = -6 2 +2^E[X(X+A)] 

i-\ 

71 

< -bl + 26„[^E(X + A) 2 ] 1/2 
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Since for any two positive numbers, a and b, we have 2ab < (1 — pi) 1 a 2 + (1 
Pi)b 2 , we obtain 



< r^bl + (i - Pl ) e(*< + A,f 

1 — Pi - 



1=1 



This last inequality, combined with (|30[) and solved for gives 

2 < 1 + Pi U 2 
1 - pi 

and the upper bound is established. 

Remark 14 Notice that for an independent vector, pi = and Proposition 
\1S\ can be viewed as an extension of the classical estimate for variance in the 
independent case, ES^ = X)"=i EX t 2 . 

As a corollary we obtain the following result in terms of the coefficient of 
contraction S defined by (jH)) that improves the known results in the literature 
(see for instance Section 1.2.2. in \7[ and Proposition 3.2 in [16]). 



Corollary 15 Let (Xi, X2, X n ) be as in Proposition\13[ If Si < 1 then 



(! + ^) 2 ti 



Proof. It was established in Lemma 4.1 in [IB] that P i >n < y~5i~n. 
Then, since the function (1— x)/(l+x) is decreasing, it follows by Proposition 
[13] that _ _ 



1 — Wdl , 9 „ ^9 I \ O [ , > 



1 



1 



5 Proofs of the main results 
5.1 Proof of Theorem Q] 

We verify the conditions of Proposition [T^J Condition (|2"B)) follows easily by 
conditions (TTTT) and (fl~2"]) combined with Proposition [13] in the following way: 

i^EX^ < %£e^ < f%% = f% -> as 00. (32) 

To verify ([2"T]) we fix e > and start from 

Eexp(tmax 1 < 3 <„ |Aj|) 



P( max I Ay I > ea n ) < 



i<j<n J exptecr„ 
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For t = A n /(6C„), by taking into account Lemma 1 171 we obtain 
P( max \ Aj \ > ea n ) < (1 + ^-)^xp(- £ ^) 

l<]<n oU n 0U n 

and then, ([2"?| follows provided we verify 

(l + ^)exp(-e^^)-^0asn^c5o . (33) 
Notice that assumption (fT2"j) implies 

' • oo as n — > oo , 



that further implies 

exp(— e— — -J — > as n — > oo . 
12G n 

Moreover 

TT exp(-e-^r) = exp ln( — ) - e—— 

O n rzl_y ra \ L^n rzo n 

and (l33l) follows if we show that 



We write now 



and notice that 



7^)- £ 7^^~°° ■ ( 34 ) 



ln(^)=l n (^) + ln(-^) 



C n 1AC n 

so, in order for (|34l) to hold it is enough to show that for and n sufficiently large 

ln( ^ n ) ^ £ ^ n ^ n 
A n cr rl 24C ra 

This fact follows if 

C " l n (J^)^o. (35) 



Now, by Proposition [13] we have 

A 1/2 /, 2 



2 -^"Ay 2, 

So, condition ([33]) is satisfied provided 

C n (l + |ln(A„)|) ^ C 
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This is exactly the condition that we impose in (fT^I) . Thus (|27|l holds. 

We verify ([28]) by analyzing the variance of both terms involved. For the first 
term we use Proposition [TJJ] together with conditions (Til"]) and (fT2l and obtain 

1 " 2 n 

-mr£*V< £ E ^< (36) 

, " < -> as n -> oo. 

To deal with the second term, first we apply Proposition[T2]to estimate the vari- 
ance, then we use condition and finally we take into account the inequality 
([nj) and so, 

1 " 2 n 

V arY J Xn, j A n , j <—^Y,^ X h A li) 

« ,-=1 A »"n j—i 

< ^ 2 2C 2 af t _ 2C 2 

n « j=l A n n A n° n 

which converges to under (|T2|) . 



5.2 Proof of Corollary [4] 

This corollary follows from Theorem [T] via a truncation argument. 

First construct e n — > slowly enough such that condition (fl"5|) is still satis- 
fied. We truncate the variables at the level T n = e n h(X n )a n , and denote 

X n j — X n ,iI(\Xn,i\ < ^n) " EX„ ( j I(|X n ^ | < T„) 

and 

We show that the contribution of 2<=i -^n i/* 7 ™ i s negligible in L2 and therefore 
is negligible for the convergence in distribution. To estimate its variance we 
apply Proposition [T3] and then we take into account the Lindeberg condition 
<fT5|) . We obtain 

n 2 ™ 

'* i— 1 ri 2=1 

4 n 

< -t— 3 J] iI{\Xn,i\ > T n ) -> as n -> 00 . 
A " a » i=i 

Then, with the notation (<r„) 2 = war X)"=i X n i we easily derive from the last 
convergence that 
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Finally, we apply Theorem Q] to X n i with C n = 2e n h(\ n )<j n . We verify (fT2")l by 
using the definition of h(X n ), since 

C n (l + |ln(A„)|) „ a n 

— , — — = 2e n — > as n -t oo . 

A„cr n cr„ 

and the result follows. 

5.3 Proof of Theorem M 

Using our tools we give a short proof of this theorem for completeness. We 
verify conditions of Proposition 1121 Notice that under the assumptions of this 
theorem Conditions (|26|) and (|28|) are verified exactly as in the proof of Theorem 
Q]by taking into account that p n ,\ < a/o^~l and replacing Proposition [13] by its 
Corollary [HI The main difference is now that condition ([27]) follows easily by 
the estimate 

< 2^7 C n a.s. 



This inequality implies 

2C 

\m^ n ,i\Uj)\\oo<- ' 

i=j+l 



1 1 - 

I |E(<SVi — 5Vij|£nj)||oo < — J]] ll-^(-^n,t|Cnj)||oQ < 



a " ' 3 / 2 u 



which converges to as n — > oo by condition (fT7|) . The theorem is established. 





6 Appendix 

In this section we estimate the moments and the exponential moments for the 
quantity Aj = A n j = E(S n — Sj\J-j) where Sj are the partial sums associated 
to a vector of centered random variables (Xj)i<j< n defined on a probability 
space (Q,IC,P), adapted to an increasing filtration of sub-sigma fields of /C, 
(Fj)i<j<n, ?Q = {0,^} and p k is defined by (P. 

Lemma 16 Let p > 2 be a real number and assume the variables have finite 
moments of order p. Then, 

n n—1 n 

^eia^I" <^ _2 (E'* /P ) P E I W • 

3=1 k=l i=l 

If for a certain < p < 1 we have p k < p k then, for any p > 2, 

n -.n 

Y.nA n ^<p*——-Y.nxA p - 

j=l v Hl i=l 
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Proof. For simplicity, we shall drop the index n from the notation. For j 
fixed, 1 < j < n, and 1 < k < n — j let 

a k = a k (j) = % P ■ (37) 

Notice that $^fc=x afc = 1- By the fact that a; — > is a convex function, we 
easily obtain 

n n 



i=j+l fc=l 

Then, since dk(j) > afc(l) and 1 — p < 0, it follows 



k=l 

Next, we use the fact that by the interpolation theory (see Theorem 4.12 in [T]), 
for p > 2, 

v\E(x j+u \?i)\ p < 2 p - 2 P inx ]+ u\ p ■ 

Combining now these two facts and summing the relations, we obtain, 

ri— 1 n — In— j 

£ E|A,r < 2^- 2 J2 E H p {i) P inx ]+k \ p 

n — 1 n 

<2^ 2 ^a^(l)p^E|^-r. 

fc=l 3=1 

By (j3"7) we notice that 

eVwp! = (EVr 
fe=i fe=i 

and the first part of this lemma follows. 

For proving the second part of this lemma we take into account that a simple 
computation based on the fact that l—x@ > (3(1— x) for < x < 1 and < f3 < 1 
gives 

n — 1 n — 1 -. 

P 1 



V pI /p = T P 2k/P < - — -r- < v — 

2_^P k l^P - 1 _ 2/p - 2 (l 

fc=l fe=l F K 



P) ' 



which combined with the first part of the lemma gives the result. 
For the next lemma we recall the definition ([5]). 



1G 



Lemma 17 Assume that there is C > such that maxi<t<„ \Xk\ < C a - s - 
and for a certain < p < 1 we have pk < p ■ Then, for any nonnegative 
t<(l-p)/(6C) 



Eexp(i max \AA) < (1 



2tb 



n \2 



l<j<n J 1 — p 

In particular for t = -gj£ we have 

EeXP ^ i m l ^ l) ^ (1 + fe )2 - 

Proof. We start the estimate by the Taylor expansion and majorate the 
maximum term by the sum: 



t" 

p=2 



Eexp(t max \AA) < 1 + — E max \Aj\ p + tE max \AA < 

l<j<n — ' pi l<j<n 



where 



1 + V V— E\Ai \ p +tE max A,- = I + II , 



p! 



By Lemma 1X61 and because by the Stirling approximation we have p p < 3 P l p\ 
for p > 2, we obtain 

V FM ip< p p VFiyp< 3Pp!CP ' 2& " 

^ E| ^' ^iO^^W * 12(1 -p), ■ 
Introducing this estimate in the expression of / we have 

- { m)pc^%i gfbi {gey-* 

~ ^ 12(1 -pY + i2(l-p)2 A.(i_ p) p-2 
For i < ^# we easily derive 



4(1 -p) 2 V l-pj ~ 2(1 - p) 2 ' 
Moreover, by Lemma [T5] it follows that 

/ n \ 1/2 

II = t(E max lA-l) << | VEA 2 ] < 



1<J 

and overall 



vJ =1 



3i 2 6 2 ^. .„ , 2tt„ 



I + IIK1+ ' " +_l^<(i + _^) 
2(1 -P) 2 1-P 1-p 

and the lemma is established. 



2 
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